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(57) Abstract 

PROBLEM TO BE SOLVED: To prepare 
hlgher-d^nlOon luminance signal by reducing a 
binary change due to the miadacrimination of 
vertical and horizontal stripes. 

SOLUTION: The signal processing method to 
acquire and treat an image signal from an Imaging 
element provided with a color filter has a 
correlation calculation stage to obtain the vertical 
and horizontal correlation values of the image 
signal (S11), a comparison stage to compare values 
based on the vertical and horizontal correlation 
values with a preset prescribed range (S13), a first 
interpolation stage to interpolate a luminance 
signal by a first Interpolation metiiod when the 
values are smaller than those of the prescribed 
range (815), a second Interpolafion stage to 
interpolate the luminance signal by a second 
Interpolation method different from the first 
interpolation method when the values are larger than 
those of the prescribed range (S16), and a third 
interpolation stage to interpolate the luminance 



signal by a third interpolation method different 
from the first and second interpolation methods 
when the values are in the prescribed range (815). 
The first to third Interpolation stages are 
performed selectivety. 
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mt'^^w^i.x^m.ir^m^^mjjm'v^^x^ mis 
xa (s 1 1) mw.m'm^mmti^W'^mmt\^^ 

(SI 3) . ttJlB^SffiSct »9/^$v^#'^l^:^l^oMra 

^r&-cj^Sfi-^^ffira-r^mioffiraxa^ (si 

oMr^lxm^ (SI 6) . mrlsm^^fflf^Tfe^^'^lc: 

T^ffSft-g-^MPp^-r-S^SOMKIxm^: (SI 5) $:*r 
U ttrlEMl75^^3(DMraxm(iS^«lc:|I^T$ii 

So 




1#^2 001-320720 



sFffi nfit ^ * i^) 6 » xm i: . 

m^^m 1 Tbmm 3 ooffirB^xaiiai^e^tcii^T^ tt^ r t 

. [ft 2 1 7k¥ffiilfi^»^»ffii-5 X^^M(-^ 
u> 

[ft*:® 31 *9ia7k¥ffli8««*ai:b. SEffiiafilSr 
VD i f f ^ *¥«I8«[^HD i f f i: Ff^CD 

a= (VD i f f -HD iff)/(2XTh)+0. 
5 

M.:^&o 30 

/^l$^i^JL^co:7-</^^^cM^S■r^«-^iJ|g^-ov^T. ±T2 
2 (^5WP^;^&-eii. :&::&2pj^(7:)|I-^fii^^i^LT^y 

^ ^ ^ ^:!jdSl UT ^ y - fflt- 5 ^ 

5 <^v^-ri^;^^c|sm^^m#^aa:;^&o so 



y^/^^\cnft>'r^^mm\z^\^^x. ±T2®^o«-^ 

[ff^^i 0] m^1oy—y'<;\-^\±^^^—um(D 
y ^ /v^x^^ . ^])-'^^y>(/i^^)^i^(Dy^^\^^izM 

M^TWcDtr. j ^®^r Wo3?U^ Lfc:^^tc:. Tic 
^fflMIK^HD iff. SEffiggftSrVD i f f ^-r-S 

HD i f f =|P(i.j.i) -P(i.j.i) | + |P(i.j-2) +P 
(i.>2) -2XP(i.j) I 

VD i f f=|P(i-i.j) -P(i*i.j) | + |P(i.j) +P 

(i.2.J) -2XP(i.j) I 

itz^y)mn^n^\ ^^m2(o^mmmn:^mx^^. 

HD i f f =|P(i. j-i) -Pci.>i) |> 
VD i f f =|P(i-,.j) -P(i.i.j) I 

m:^m 1 0 iciE«o<f ^^s;^&o 

21 :^y-y>(/i'^^V^^itm^m'^i^^h 

mmt-^ ^ u x s w-^-^ssgT ^ o r . 

:^&^ttM''j^^>m3<DMRg:^fet?]^Sm-^S:MFHl-r«>m 
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«[^VD i f f i: U Tk^ffillfil^HD i f f ^ 10 

a= (VD i f f - HD i f f ) / (2 XTh) +0. 
5 

im^mi 6] S&IE^17!;iES3 0Sra:frffi-e(i. w 

[If 5^311 8] #IlEMii:tgiHit^*¥*SgHa^t-S<5 
1 6C^)V^-fn;^^c|E®o^t-^^3®^®o 40 
(Dy^^u^\cMJt^ir^^mm\z^\^^X. ±T2pi^c^m 

m-^m<om(omMmxh^zt^i^Wit'r^m^^i 2 

m^^m 1 2 7bm 1 9 <^V>-f ;h.X>^lClS^(Dm-^^3S^©o 50 



y /v^xhX^ . if^)—i^y^/^^&.^<Dy^;v^\z.^ 
JS1-6^y-:^<t^MraoS**H*SrPi3 ^ U i S: 

¥fflllfii[^HD iff. HiE^ilifitSrVD i f f <!:-r5» 

HD i f f=|P(i.j.i) -P(i.>i) | + |P(i.j-2) +P 
(i.>2) -2XP(i,j) I 

VD i f f =|P(i.i.j) -P(i+i.j) | + |P(i.j) +P 

(i.2.j) -2XP(i.j) I 

^ci^5ili®^^TV^. mm%2(oi^mm^'^^mx\±. 

HD i f f =|P(i. j-i) -P(i.>i) U 
VD i f f =|P(i-i.j) -P(i.i. j) I 

[»*:3S2 2] mmmi^^km-is nrnm^^mf^-t^ 

2 3 ] If 1 1 1 ov^Ti^:el>^cf5®o 

[0 0 0 1 1 
[0 0 0 2] 

IS5 0 2t^Scoy^>-d5|ilE^tt> j^Sy ';/^lHl^5 1 

otc:a|p>ix6o »sy ^y'^iHiKs 1 omr. siEn-x'? 
y^y^/v^ (VLPF) ^m\^x. mU:hmc^(0'r^ 

ttSo 7K¥:frf^t>lwa»-7fc^n-y?>?^:7H'7u^ (HLP 

F) xD^m^mtm^fi^. ^t. z.(oy 

>c/i-^^nmy y'^y-^^^i^ t^So ^t^^s tK^^o 

hV'?;^:7.r/i^i5' (HBPF) |E]gS 5 1 1 ^U^HK/O' K 
/'?;^:7>f /W^ (VBPF) lHl£&5 1 4tcJ:oT. 



I 
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[0 0 0 3] ^CO^, SiE^t>l-PP (Aperture 

Peak) Ga i n IeJBS 5 1 2RrJ5 1 5-CM*Id5^S$ 
tl. ^—Ts^y) yrf (BC) 11IK5 1 S^U^S 1 67?/h 

1 T-CTk^^^i-irMK^^J'^d^^D^^tv. APC (Apertu 
re Control) Ma i n G a in 5 18 "C^ ^ 

^tt^o -^co^. ;?f:^-^^felH]K5 2 0-x?;^/v-^^^:6S 
ife^n^. nm^lE (YC0MP)[HlK5 2 1-c. 'fet;iJ:5iliS 

[0 0 0 4] ^fc. -feit-^^S^LT. feMr^^lHJKSO 

ct 5i-Mr^$tL. -fe^^-^hy^;^ (mtx) iukso 

4JCT«fe{t-^36S»SfI^ (Y) (C r . 

Cb) ^c^^^n-^WiBE (CSUP : Ch 

roma Supress) 5 0 5 J: o T^g;^^ffi:&0^^S3WS^ 

(CLPF) IhISSS 0 6t;iT^:®:a5^if5S^fu5o ^«^J 

RGB^f-^^c^^$i^5i:l^^^c;^f>--7^»^sig$^^ 20 
So :«r>-e^^«ORGB{t-^«i^t5Y. Or. Cbm 
-^(il^^^tts CGa inKnee (ChromaGain Knee) 
^m^Xl^^^^d^t'^mmi'^fl. LCMTX (Linear CI 
ip Uatrix)lHlK5 0 DlCT. ^i^(0Wi0^1EJkXf. 

[0 0 0 5] ::;i-e. la? ic^-r<t 
5>gt3^5J:v^fci^^c. ^J;tt-f!El8 (a) o<}:5t-. 

X^-r. ^if^if (i^^^) ir^'j^oTM^Hfi^^^®®^ 
^e^b^-lir-CL^Po WT«c. Els (b) Sr#RP,bTHl;i 

P 5 (G) = (P 2 (G) + P 8 
[0 0 13] VD i f f >HD i f f tKT 

P 5 (G) = {P4 (G) +P 6 
[0 0 14] HJC. Vd i f f =HD i f f 
:RTJ5iiei^:^oiif^SrflBv\ ^ (4) ^m^^^xW^ir 

P 5 (G) = (P 2 (G) +P 8 

[0 0 15] ±iB<^j: 5{cur. ^v->m-^si^^m 

P2 (R)= ((PI (R) -PI (G)) + (P3 (R) -P3 
P4 (R) - ( (P 1 (R) -P 1 (G) ) + (P7 (R) -P7 
P5 (R)= ( (PI (R) -PI (G) )+ (P3 (R) -P3 
P5(G) - (5) 

[0 0 17] -e^de>s w^dst^^So rZ/v—ft-^^P^H 

Y=0. 3 XR + 0. 5 9 XG + 



[0 0 0 6] ms (b) fi. m^^<^*iii^?5=*e>cofca 
mm^tcDfz}^. ti:^^±^\^^m^mt}'r^mm^^x. 

W;^^s{^^^0Tfe^ii^^^aT^bTv^-5o wOip 

orm^^^o Xt-. LPFIilctoT^-^^^^^ (MT 

[0 0 0 7] -^rn-c. ro-=^-Y=3E^^lH]>e-t-5;^«>lc:^T 

(Dx 0 tmm^mm&m^^^^mtm^^inx\^^o 
ibmrn-t^^tx. nmm-^(Di^-r^^m<:h(oxh 

So 

[0 0 0 8] i^T. Mi^:ffira3Sffi^t■^f^^^ffi^cov^ 

[0 0 0 9] ^■r^y-i^m-i-oarasr*T5o m^\^. 
-rso mb. ) . ®^p sicisit'Si/y-^it-^ (P5 

(G) ) 0Sra:*ftfiWT05i!9Tfc5c 
[0 0 1.0] 1.^(1) (c^ »?ffir^^^O±T. 
OB^O^Ojfe^ffi (HD iff, VD i f f ) 

So 

HD i f f = I P4 (G) -P 6 (G) K 

VD i f f = I P 2 (G) -P 8 (G) I •••(!) 

[0 0 11] 2. :^^^)fc^fe>k^^ii^-^<5v^'r. Mr^ott:;^ 

[0 0 1 2] VD i f f <HD i f f /jrfeff. ^ECOM 
^^^v>. ^ (2) iSr^v^-rMF^-rSo 

(G) ) /2 (2) 

oMS^ffivN. ^ (3) ^^v>-c«rB^i-5o 

(G) ) /2 - (3) 

So 

(G) +P4 (G) +P6 (G) ) /A 

... (4) 

[0 0 16] ^fc. l^^yKfi-^fis 

(G)))/2^P2(G) 
(G)))/2+P4(G) 

(G) ) + (P7 (R) -P7 (G) )+ (P9 (R) -P9 (G) ) ) /4+ 

V^-CRGB 3'fe5>om-§-^#Sr 
0. 1 1 XB ••• (6) 



(5) 
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ct D)@^if-§-Y^5|cJ65c t.ti^ 1 -2 7 5 3 ^^:g^lc^-^<^^ixfc::^^--fli:c^Mr^tc^-r6$f 

[0 0 18] #||2l£8-2 9 8 6 6 9-^^«-e »S:*i?>S«-&J-. ® 1 0 (C^i-ga?IJlC*5V>T 

HD i f f = I P32(G)-P34(G) I + I P31 (B)+P35 (B) -2XP33(B) I 
VD i f f = I P23(G)-P43(G) I + I P13(B)+P53(B) -2XP33(B) | 

- (7) 

[0 0 191 (O^0^J:m2m,/ktti'eixM:t^:it'X^^ ^n^/v^^USUtc^^Mif #^ffiv>TV>-5fc: 

[0 0 2 01 fe^m-^-^^^M^^t-Oi-Z^oTb^l^ (m:t\tPS 

i^mi)m^\^^o tir^'^m] \^t^i.ti:t^hs ±is^ (G) ^mr^^-r^m-^. Hd i f f = i (p 5 (b) - 
(1) - (6) {c^'t'i^tM(Dmft>w^^m'v\^. fimm P2 (o ) - (ps co -pb (o ) 1=0. v 

3KSWJ-e2fitWlcMB8SrrS3S:§Ji9#X.TV>6fcJ?>. Si d i f f = I (P 5 (B) - P 4 (G) ) - ( P 5 

1 (a) <Dx^tj:im^\i'y'^(Dmco^^m::^is\^^xm (g) -p6 (g) ) 1=0) . =^yz^m^u^^'^m\z 
m^itmmp 5^mm\^xi^^ir^m^. voi f fj:ox\.'^^^KMi)^hoito sbt-. fe^^f-^o^fe^^ia: 

f {= I P 2 (G) -P 8 (G) I =0) . HD i f f 20 m^^^^^^^^ Ml S(0 (a) J; 5 ^ "S^ 

(=|P4 (G) -P6 (G) 1=0) <Dm^<Dmi)^\^ (Dm^s mis (b) (DX^\Cfzt:t\^. P2 (G) = 

\^OtfJ:^o :i(Df^^. Wt^m^(Dy-(::<fj:^(DB^X P4 (G) =P6 (G) =20, PI (R. B) =P3 

m^lJ^^troT U:^V^. HI 1 (b) (R. B) =P5 (B. R) =7 0, P7 (R, B) = 

mmtmni^hiDW^t^^^^j^ {^mm) \c2m^\^^ p9 (r. b) =170, P8 (g) =120. <dxo 
y)mt>y) {mmmM(Dmm^}) . ;^*^5-<t•T?^iv^i fj:^=^yi^<Dm^. ps (g) ^:^it>^t-r^t. 

:L^\cmt^%±ir^t\^^^X^f>^^-:>tZo ¥1 1-27537 3-^{i^m^^®,<omf^:^^X t =y 

[0 0 2 11 ^mW- 11-275373 -g-^«iB = 0 . 5 ^ bXtf-»-r^ t 

TK^SffilS : Ctsum = ( I P5 (B .R) >P4 (G) [ + 1 P5 (B .R) -P6 (G) | ) /2=50 . 
mmmUm • Cysum = ( l ps CB .R) -P2 (G) I + 1 P5 (B .R) -P8 (G) I ) /2=50 

- (8) 

[0 0 2 6] 

6^2 offlF«^:;^&T3^Sm^^Mr«^-r5^ 2 coffip^x^ 
[0 0 2 7] ^fc. :fy9—:7>(/i^^^m:^itm^m^t)> 

bmmB'^^m^\^xmim-r^^^m(Dm-^^m^m 
50 fi. Mt2®^m"^f^^E::^rR]oilE*eSi«S.t/7K¥:^fS] 



[0 0 2 2] ^3^il}. 7k¥S«aSd5S5< j^ji6-<#^::^ 

fci?). Eil3 (c) ici^-f-J: 5tCfe3^y v^tCjoJt^i^^ 

9 8 6 6 9-^<£^m(D^^^m^^x^m-^(omm^n^ 
[0 0 2 31 ±Ti^>r>-oj5^y— ^^ff-^ji 

[0 0 2 4] :i^^m^t±t^mm^\:i§^^Xfj::^fiti'k(0 

xhy>. nmt'^i^^^co^ V ->m^^mm\z. 

«J^|g4^JSiJtJ:<tS2lt&«3?'Jt^>)#*?'9^ig;«^-^> 

[0 0 2 5] ^fz^ mm. mmmm(Dmi^^\^±^^^ 



(6) 
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[0 0 2 81 ^fc. ^^m<otit^mfji-mM\^^^\^. tk 

[0 0 2 9] 3Et;::»^ b < S9IB7K¥^=Bia«IS a ^ 
f f ^ U gf^oBHE^Th t 

a= (VD i f f-HDi f f) / (2XTh) +0. 20 
5 

[0 0 3 0] -e#^^H'5o ^fc$?*u<(i. mm^y 

2iifSioft^fii:^5ii*|,ux^y->'{i-^^»ttiu. esia 

m3(OffifB^::^^-Cfl. :&;&2®^om-^ffio5f*^tC7K¥^ 

[0 0 3 1] ^fc. ttr 

fB^l7!7Sm3 0«r^:*'&-CJ±. Us/ K:7^/l':^J!^^<D 

[0 0 3 2] ^fc. ^ 
[0 0 3 3] ^fc. ;z^^^oJ?M?'cfi5'Jo-^^{3:J:fL 

[0 0 3 4] ^fc. :^^m<otifmti:-mm\cxivi'£. m 

;5#M^^-ov^T. ±T2iljmom-^^c^Mote>t^^iI-C 
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[0 0 3 5] atz. ±M^2<onm-k^^-r^tiMz.^ 
mm^:^mt. ^2<ommmmn:^mtk^M^m\cm'^ 

[0 0 3 6] *:^0^co»iS/j^-1llfl|lcj::h.f^. ttrlS;*?^ 

TU-^o^iJ^ Ufc^^tn, TK^ffi^M^HD i f f . ^ 
EtaiHt^VDi f f ^i-S^. ttflE^l^o^BlifflSt^ 

HD i f f=|P(i.j-i) -P(i.>i) | + |P(i.j.2) +P 

(i.>2) '2XP(i.j) I 

VD i f f =|P(i.i.j) -P(i.i.j) | + |P(i.j) +P 

(1.2. J) -2xP(i.j) I 

[0 0 3 7] \zx^m»kn\^\ m^m2(D^mmm^ 

HD i f f = |P(i. j-i) -P(i.>i) U 
VD i f f =|P(i-i. J) -P(i+i. J) I 

w^mkmn\^. m&^i^^mit^fj:\^^m^\^itm2<D 

[0 0 3 8] 

[0 0 3 9] cm 1 (ommmmi m 1 ^^^^(Dm 1 

»my y^m&S 1 0 ;S5ajS»SffiraiiIK 5 5 0|;::^:b 
[0 0 4 0] H 2 fi. 3SiS^»SMrH^[H]gS 5 5 0 CO^S« 

^^^i->^no,^[gi-efo5o ja)Sj@S[ffirB^iHiss5 5 of± 

tiBiffiSlttiSiSS 6 0. GffiraSfPS 7 0. R • B*frai?I5 5 
8 0 . RXfn&^^& 5 9 0 t k^-r^o 

[0 04 1] ^T. :^^m(Dm 1 (ommmm\c^^i)^^± 
mk^-ty^—"^^— \^xh^o 

[0 0 4 2] ^y-vft#2:5SlS:W 

mmm^^}<DU^\c!t^\:.x7i^w^^\^mm. mm.:^{^mm^ 
2mm:L^^m^^(o-x:nfj:<. mm. mmmmxmm 
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[0 0 4 3] *-f. i/y-:^W^O:^T<0]ii5». -r?ii:> 
m-r^ i:^'r^y':^S i l~S l 5) o -POx.fOT 7 

(P5 (G) ) ^mm-r^m^. mmm^m^se 

5o (Xx^>>^Sl 1. tlKS^ffi) 
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HD i f f = t P4 (G) -P6 (G) K 
VD i f f = I P 2 (G) -P 8 (G) I - (9) 
[0 0 4 4] Igf^lZ^ HD i f f t VD i f f OgS:^ 

[0 0 4 5] Cir-Cfl. ^m&^ti^^S 6 OTbm^a 

(yi(,W-^m^M) ^^LttiU. GSfB^as 7 Od5r(DSt±i 

[0 0 4 6] ^-f. ^T<^^ (10) ^ffiV^TTK^+SM 
^Sa^Sm-f-S (P^7^:y:7^S 1 2) , 



a= (VD i f f-HDi f f) / (2XTh) +0. 



(1 0) 



^(11) ^ffiv^x. SH-*¥MPflt^l&?l^«0l9#;t^ 



10 0 4 7] #^tLfc7K¥*i^#^atCi: ^T<?5 3 
3) o 

1. (O^a^l) (Om^ (y^Tyy'S 1 A) 

10 0 4 8] TK^^iRjo^^sn^^E^-fpico^aiidSifiiau 

P5 (G) = (a (P4 (G) H-P6 (G) ) + (l-a) (P2 (G) 
+ P 8 (G) ) ) /2 - -(11) 
[0 0 4 9] 2. (a<0) (D^^ y':f S 1 5) 

[0 0 5 0] sa:&fR]cD*g|i2!)5^v^/ci?). m\M,:^{^f)>b 

P5 (G) = (P2 (G) +P8 

[0 0 5 1] izx^mm-rao 

3. {a>l) (Om^ (>^7^$/:7^S 1 6) 

P5 (G) = (P4 (G) +P6 

[0 0 5 3] \zxy>mm'r^o (S4n. ^ do) ^± 

So i-i^j^^b^. (a<0) oJg-^fi, Iil4ic^-ri: ptd 30 
o = Oi:UT* (11) tcf^A-rtufi. * (12) tm 
fctb. ( a > 1 ) COJ^'&lCti, a = 1 ^ LT^ (11) 
^cftA-ri^«> ^ (13) ^#ibtt5C^^^bTV^ 

[0 0 5 4] ^X(D';r/l^—m^RXfU>y 

P2 (R) = ( (P 1 (R) -P 1 (G) ) + (P3 (R) -P3 (G) ) ) /2+P2 (G 1 ) 
P4 (R) = ( (P 1 (R) -P 1 (G) ) + (P7 (R) -P7 (G) ) ) /2+P4 (G 2 ) 

P5 (R) « ( (P 1 (R) -P 1 (G) ) + (P3 (R) -P3 (G) ) + (P7 (R) -P7 (G) ) + (P9 (R) -P9 (G) ) ) /4+ 

P5(G) (1 4) 

[0 0 5 6] ^tc. >^yl— m-^fcl^^fOff'StClJ; f9^«> 40 fe5><^m-^^#So HlC. mm±^mS 9 0^C*3V^T. 

5::i:;65T?#So ::n(-<J: 19 1^— iU^t:::*oVNTRGB 3 fi?9x.f^m s c :&^<o^^£rfflv^, 

Y=0. 3XR+0. 59XG+0. IIXB •••(15) 



(G) ) /2 (1 2) 

[0 0 5 2] *^:frIp]OtlH;65^v^:/b«>. 7k^*iRj;5^<b 

(G) ) /2 ••• (1 3) 

[0 0 5 5] ^fc. R • BMr^^ffls 8 0 ici^vNT. mm 

oV^TU5/ Kfi^Srffirai-S (y^'T^yrT'S 1 7) o 
®iS^cov^T^:i. ii3a2(^4o<ow$/ K|iiigS:^V>-C. 1^ 



[0 0 5 7] Xy)m&iB-^Y^:^it^ (;^7^iy:/Sl 
8) o tii^s ^(15) <D^:J^<D^m^. iSH^S-f-S 
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